What is claimed is: 



1 1. A media processing apparatus which inputs a data 

2 stream including compressed audio data and compressed video 

3 data, decodes data in the inputted data stream, and 

4 respectively outputs the decoded audio data and the decoded 

5 video data to an external display device and an external audio 

6 output device, the media processing apparatus comprising: 

7 an input/output processing means for performing an 

8 input/output processing asynchronously occurring due to an 

9 external factor, the input/output processing including 



10 q inputting the data stream which is asynchronously inputted, 

11 % storing data in the inputted data stream into a memory, and 
111 " ■ -; ! 

12 r J1 supplying the data stored in the memory to a decode 4 processing 



13 % means; and 

w i 

14 f . the decode processing means which, in parallel with the 

15 f| input/output processing, performs a decode processing where 

16 :{£ decoding of the data stream stored in the memory is mainly 

17 performed, and 

18 wherein the decoded video data and the decoded audio 

19 data are stored in the memory, and 

20 wherein the input/output processing means reads the 

21 decoded video data and the decoded audio data from thgi memory 

22 in accordance with respective output rates of an external 

23 display device and an external audio output device, and 

24 respectively outputs the read video data and the read audio 

25 data to the external display device and the external audio 
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26 output device. 

1 2. The media processing apparatus of Claim 1, wherein 

2 the decode processing means is composed of: 

3 a sequential processing means for performing a 

4 sequential processing, which is mainly for condition 

5 judgements, on the data in the data stream, the sequential 

6 processing including a header analysis of the compressed audio 

7 data and the compressed video data and a decoding of the 

8 compressed audio data; and 

9 K a routine processing means for performing a routine 

10 rJ processing in parallel with the sequential processing, the 

~Z " . '•• , ii 

"Sj. 8 ^ 

11 in routine processing including a decoding of the compressed 

12 % video data except for the header analysis. 

1 | 3. The media processing apparatus of Claim 2, 

2 £ wherein the sequential processing means alternates 

3 ^ between performing a header analysis for analyzing a header 

4 which is assigned to a predetermined unit of data 

5 (hereinafter, called a "block") in the data stream and 

6 performing a decoding of the compressed audio data in the data 

7 stream, instructs the routine processing means to decide a 

8 block when the header analysis for the block is completed, and 

9 starts the header analysis of a next block when receiving 

10 notification from the routine processing means that the 

11 decoding of the block is completed; and 
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wherein the routine processing means decodes the 
compressed video data for a block in accordance with a result 
of the header analysis given by the sequential processing 
means . 

4. The media processing apparatus of Claim 3, wherein 
the routine processing means is composed of: 

a data translation means for performing variable length 
code decoding (abbreviated as the "VLD" hereafter) on the 
compressed video data of the data stream in accordance with an 
instruction from the sequential processing means; 

a calculation means for performing inverse quantization 
(abbreviated as the "IQ" hereafter) and inverse discjrete 
cosine transformation (abbreviated as the "IDCT" hereafter) by 
executing a predetermined calculation on a video block 
obtained through the VLD; and 

a blending means for restoring video block data which 
corresponds to the video block by blending a decoded 
rectangular image of a frame stored in the memory with the 
video block data on which the IDCT has been performed. 

5. The media processing apparatus of Claim 4, ^herein 
the calculation means includes 

a first buffer having a storage area whose capacity is 
equivalent to one block, and 

wherein the data translation means includes: 
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6 a VLD means for performing the VLD on the compressed 

7 video data of the data stream; 

8 a first address table means for storing a first address 

9 sequence where addresses in the first buffer are arranged in 

10 an order for a zigzag scan; 

11 a second address table means for storing a second 

12 address sequence where addresses in the first buffer are 

13 arranged in an order for an alternate scan; and 

14 a writing means for writing block data obtained through 

15 the VLD performed by the VLD means into the first buffer in 



16 p accordance with one of the first address sequence and the 

is: sir. 

17 q second address sequence. 



1 p 6. The media processing apparatus of Claim 5, wherein 



2 ^ the writing means includes: : 

3 pj a table address generate means for sequentially 

4 Jj: generating a table address for the first address table means 

5 r ^ and the second address table means; 

6 an address select means for sequentially selecting one 

7 of an address of the first address sequence and an address of 

8 the second address sequence which are separately outputted 

9 from the first table means and the second table means .{into 

10 which the table address has been inputted; and 

11 an address output means for outputting the selected 

12 address to the first buffer. 
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7. The media processing apparatus of Claim 1, wherein 
the input/output processing means is composed of: 

an input means for inputting an asynchronous data 

stream; 

a video output means for outputting the decoded video 
data to the external display device; 

an audio output means for outputting the decoded audio 
data to the external audio output device; and 

a processor for executing task programs from a first 
task program to a fourth task program stored in an instruction 
memory, by switching between the four task programs, the task 
programs including : 

the first task program for transferring the ^dafca stream 
from the input means to the memory; 

the second task program for supplying the data' stream 
from the memory to the decode processing means; 

the third task program for outputting the decoded video 
data from the memory to the video output means; and 

the fourth task program for outputting the decoded 
audio data from the memory to the audio output means. 

8. The media processing apparatus of Claim 7, .^herein 
the processor is composed of: 

a program counter unit including at least four program 
counters corresponding to the task programs from the first 
task program to the fourth task program; 
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6 an instruction fetch unit for fetching an instruction 

7 from the instruction memory which stores the task programs, 

8 using an instruction address designated by one of the program 

9 counters; 

10 an instruction execution unit for executing the 

11 instruction fetched by the instruction fetch unit; and 

12 a task control unit for controlling the instruction 

13 fetch unit to sequentially switch the program counter every 

14 time a predetermined number of instruction cycles have 

15 elapsed. 



1 | 9. The media processing apparatus of Claim 8, wherein 

Si ■ - -i 

2 pj the processor is further composed of 

3 f k a register unit including at least four register sets 




corresponding to the program tasks from the first task 5 program 
to the fourth task program, and 



s-ss 

6 J: wherein the task control unit, simultaneously with 

7 ?"* switching of a program counter, switches a present register 

8 set to a register set which is to be used by the instruction 

9 execution unit. 

1 10. The media processing apparatus of Claim 9,^ wherein 

2 the task control unit is composed of: 

3 a counter for counting a number of instruction cycles 

4 in accordance with a clock signal every time the program 

5 counter is switched; and 
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6 a switch instruction unit for controlling the 

7 instruction fetch unit to switch the program counter when a 

8 count value of the counter reaches the predetermined number. 

1 11. The media processing apparatus of Claim 10, 

2 wherein the decode processing means is composed of: 

3 a sequential processing means for performing a 

4 sequential processing, which is mainly for condition 

5 judgements, on the data in the data stream, the sequential 

6 processing including a header analysis of the compressed audio 

7 p data and the compressed video data and a decoding of the 

p 

8 p compressed audio data; and 

9 rjj a routine processing means for performing a ^routine 

10 ifi Processing in parallel with the sequential processing, the 

11 ^ routine processing including a decoding of the compressed 

12 S*[ video data except for the header analysis. 

6 

1 12. The media processing apparatus of Claim 11, 

2 wherein the sequential processing means alternates 

3 between performing a header analysis for analyzing a header 

4 which is assigned to a predetermined unit of data 

5 (hereinafter, called a "block") in the data stream anc^ 

6 performing a decoding of the compressed audio data in the data 

7 stream, instructs the routine processing means to decode a 

8 block when the header analysis for the block is completed, and 

9 starts the header analysis of a next block when receiving 



87 



0 notification from the routine processing means that the 

1 decoding of the block is completed; and 

2 wherein the routine processing means decodes the 

3 compressed video data for a block in accordance with a result 

4 of the header analysis given by the sequential processing 

5 means* 

1 13. The media processing apparatus of Claim 12, 

2 wherein the routine processing means is composed of: 

3 a data translation means for perfo:nriing variable length 

4 p code decoding (abbreviated as the "VLD" hereafter) on the 

5 g compressed video data of the data stream in accordance with an 

6 ry instruction from the sequential processing means; ^ 

7 p a calculation means for performing inverse quantization 

8 y: (abbreviated as the "IQ" hereafter) and inverse discrete 

9 |] cosine transformation (abbreviated as the "IDCT" hereafter) by 

10 % executing a predetermined calculation on a video block 

11 r "~ obtained through the VLD; and 

12 a blending means for restoring video block data which 

13 corresponds to the video block by blending a decoded 

14 rectangular image of a frame stored in the memory with the 

15 video block data on which the IDCT has been performed.^ 

1 14. The media processing apparatus of Claim 13, 

2 wherein the calculation means includes 

3 a first buffer having a storage area whose capacity is 



4 equivalent to one block, and 

5 wherein the data translation means includes: 

6 a VLD means for performing the VLD on the compressed 

7 video data of the data stream; 

8 a first address table means for storing a first address 

9 sequence where addresses in the first buffer are arranged in 

0 an order for a zigzag scan; 

1 a second address table means for storing a second 

2 address sequence where addresses in the first buffer are 

3 (** arranged in an order for an alternate scan; and 

4 p a writing means for writing block data obtained through 
.5 ill the VLD performed by the VLD means into the first buffer in 

.6 ji accordance with one of the first address sequence and the 
.7 second address sequence. i 

s s 

1 l Z 15. The media processing apparatus of Claim 14,. 

;sjj,ss 

2 |*f wherein the writing means includes: 

3 a table address generate means for sequentially 

4 generating a table address for the first address table means 

5 and the second address table means; 

6 an address select means for sequentially selecting one 

J* 

7 of an address of the first address sequence and an address of 

8 the second address sequence which are separately outputted 

9 from the first table means and the second table means into 
LO which the table address has been inputted; and 

LI an address output means for outputting the selected 

89 



2 



address to the first buffer. 



1 16. A media processing apparatus comprising: 

2 an input means for inputting a data stream including 

3 compressed audio data and compressed video data; 

4 a sequential processing means for performing a 

5 sequential processing which is mainly for condition 

6 judgements, the sequential processing including performing a 

7 header analysis for analyzing a header which is assigned to a 

8 predetermined unit of data (hereinafter, called a "block") in 

9 E the data stream and performing a decoding of compressed audio 
,0 S data of the data stream; and 

Li a routine processing means for performing, in. parallel 

L2 % with the sequential processing, a routine processing which is 

L3 f mainly for routine calculations, the routine processing 

14 O including a decoding of the compressed video data of the data 

L5 i 5 stream for a block using a result of the header analysis, and 

fees? 

16 M wherein the sequential processing means instructs the 

17 routine processing means to decode the block when the header 

18 analysis of the block is completed, and starts the header 

19 analysis of a next block when receiving notification from the 

20 routine processing means that the decoding of the blocJ» is 

21 completed. 

1 17. The media processing apparatus of Claim 16, 

2 wherein the routine processing means is composed of: 
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3 a data translation means for performing variable length 

4 code decoding (abbreviated as the "VLD" hereafter) on the 

5 compressed video data of the data stream in accordance with an 

6 instruction from the sequential processing means; 

7 a calculation means for performing inverse quantization 

8 (abbreviated as the "IQ" hereafter) and inverse discrete 

9 cosine transformation (abbreviated as the "IDCT" hereafter) by 
-0 executing a predetermined calculation on a video block 

.1 obtained through the VLD; and 

.2 a blending means for restoring video block data by 

13 p~J performing motion compensation processing which is achieved by 



L4 K blending the decoded block with the video block on which the 
L5 J\ IDCT has been performed, and 4 

m 



L6 • • % wherein the sequential processing means is composed of: 

L7 % an obtaining means for obtaining header information on 

L8 O which the VLD has been performed by the data translation 

L9 4j* means; 

20 H an analyzing means for analyzing the obtained header 

11 information; 

12 a notifying means for reporting parameters obtained as 

13 a result of the header analysis to the routine processing 

24 means; , ^ 

25 an audio decoding means for decoding the compressed 

2 6 audio data of the data stream inputted by the input means; and 

27 a control means for stopping an operation of the audio 

28 decoding means and activating the obtaining means when 
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19 receiving an interrupt signal from the routine processing 

JO means that indicates a decode completion of the block, and for 

31 instructing the data translation means to start the VLD on the 

32 compressed video data of the data stream when the parameters 

33 have been indicated by the notifying means, 

1 18. The media processing apparatus of Claim 17 , 

2 wherein the analyzing means calculates a quantization 

3 scale and a motion vector in accordance with the header 

4 information, and 

5 -j!: wherein the notifying means notifies the calculation 

6 g means of the quantization scale and notifies the blending 
w ■ 

7 - means of the motion vector. 

1 19. The media processing apparatus of Claim 18 ; wherein 

2 0 the calculation means is composed of: 

'fi s ' 

3 JS a first control storage unit and a second control 

4 m storage unit which each store a microprogram; 

5 a first program counter for designating a first read 

6 address to the first control storage unit; 

7 a second program counter for designating a second read 

8 address; ^ 

9 a selector for selecting one of the first read address 

10 and the second read address and outputting the selected read 

11 address to the second control storage unit; and 

12 an execution unit, which includes a multiplier and an 
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3 adder, for executing the IQ and IDCT in block units according 

4 to microprogram control by the first control storage unit and 

5 the second control storage unit. 

1 20. The media processing apparatus of Claim 19, wherein 

2 the execution unit separately performs a processing using the 

3 multiplier and a processing using the adder in parallel when 

4 the second read address is selected by the selector, and 

5 performs the processing using the multiplier and the 

6 processing using the adder in coordination when the first read 

7 address is selected by the selector. 

, ... „ ,| 

1 2i 21. The media processing apparatus of Claim 20/ 

ry 

2 *5 wherein the calculation means is further composed of: 

m 

3 * a first buffer for holding a video block inputted from 

4 O the data translation means; and 

5 JS a second buffer for holding a video block on which the 

6 H IDCT has been performed by the execution unit, and 

7 wherein the first control storage unit stores a 

8 microprogram for the IQ and a microprogram for the IDCT, 

9 wherein the second control storage unit stores a 

L0 microprogram for the IDCT and a microprogram for transferring 

11 a video block on which the IDCT has been performed to the 

12 second buffer, and 

13 wherein the execution means executes a processing to 

14 transfer the video block on which the IDCT has been performed 
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5 to the second buffer and the IQ processing of a next video 

.6 block in parallel, and executes the IDCT processing of the 

.7 next video block, on which the IQ processing has been 

L8 performed, using the multiplier and the adder in coordination. 

1 22. The media processing apparatus of Claim 21, 

2 wherein the blending means further generates a 

3 differential block representing a differential image from 

4 video data which is to be compressed; 

5 wherein the second buffer stores the generated 

6 p differential block, 

6 

7 p wherein the first control storage unit further stores a 

8 iy microprogram for discrete cosine transformation (abbreviated 

9 m as the "DCT" hereafter) and a microprogram for quantization 

is ! 

10 processing (abbreviated as the "Q processing" hereafter) , 

11 St wherein the second control storage unit further stores 

12 ]Sj a microprogram for the DCT and a microprogram for transferring 

13 r ~ the video block on which the DCT has been performed to the 

14 first buffer, 

15 wherein the execution means further executes the DCT 

16 and Q processing on the differential block stored in the 

17 second buffer and transfers the differential block on jwhich 

18 the DCT and Q processing has been performed to the first 

19 buffer, 

20 wherein the data translation means further performs 

21 variable length coding (abbreviated as the "VLC" hereafter) on 



94 



the block stored in the first buffer, and 

wherein the sequential processing means further assigns 
header information to a block on which the VLD has been 
performed by the data translation means. 

23. The media processing apparatus of Claim 19, 
wherein the input means further inputs polygon data, 
wherein the sequential processing means further 

analyzes the polygon data and calculates vertex coordinates 
and edge inclinations of the polygon, and 

wherein the routine processing means further generates 

image data of the polygon in accordance with the calculated 

■ - ■• : ! 

vertex coordinates and edge inclinations. 4 

24. The media processing apparatus of Claim 23, 
wherein the first control storage unit and the second 

control storage unit each store a microprogram for performing 
a scan conversion based on a digital differential analyze 
algorithm, and 

wherein the execution unit performs the scan conversion 
based on the vertex coordinates and edge inclinations 
calculated by the sequential processing means according to 
control of the microprogram. 

25. The media processing apparatus of Claim 18, wherein 
the calculation means is composed of: 
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a first control storage unit and the second control' 
storage unit for respectively storing a microprogram; 

a first program counter for designating a first read 
address to the first control storage unit; 

a second program counter for designating a second read 

address ; 

a selector for selecting one of the first read address 
and the second read address and outputting the selected 
address to the second control storage unit; and 

a plurality of execution units for executing the IQ and 
IDCT in units of blocks according to control of the 
microprogram by the first control storage unit and the second 
control storage unit, each execution unit including ^a 
multiplier and an adder, and 

wherein each execution unit takes charge of a .partial 
block which is divided from the block. 

26. The media processing apparatus of Claim 25, wherein 
the calculation means is further composed of: 

a plurality of address translation tables which are set 
corresponding to the plurality of execution units, each 
address translation table storing translated addresses^ whose 
order is partially changed in a predetermined address 
sequence; 

an instruction register group including a plurality of 
registers which each store a microinstruction associated with 
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10 one of the translated addresses, each microinstruction forming 

11 part of a microprogram that realizes a predetermined 

12 calculation; and 

13 a switching unit, which is set between the first and 

14 second control storage units and the plurality of execution 

15 units, for outputting microinstructions from the instruction 

16 registers to the plurality of execution units in place of a 

17 microinstruction outputted from one of the first control 

18 storage unit and the selector to every execution unit, and 

19 wherein when the first read address or the second read 

20 tj address is an address of the predetermined address sequence, 

21 9 the address is translated into the translated addresses by the 

a 

22 y address translation tables, and 

in l 

23 3 P wherein the instruction register group outputs the 

fear . ( 

24 * microinstructions corresponding to the translated addresses 

25 C3 outputted from the address translation tables. 

1 U 27. The media processing apparatus of Claim 2 6, 

2 wherein 

3 when a microinstruction indicating one of an addition 

4 or subtraction operation is outputted from one of the 

5 instruction registers, each address translation table jputputs 

6 a flag showing whether the microinstruction indicates an 

7 addition or a subtraction while the first program counter is 

8 outputting the first read address in the predetermined address 

9 sequence, 
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the plurality of execution units perform addition or 
subtraction in accordance with the flag, and 

the flag is set in accordance with the microinstruction 
of the second control storage unit, 

28. The media processing apparatus of Claim 26, 
wherein the second control storage unit further outputs 

information showing a storage destination of a 

microinstruction execution result at a same time of an output 
of the microinstruction stored in the register while the first 
program counter outputs the first read address of the 
predetermined address sequence, and 

wherein each execution unit stores the execution result 

in accordance with the storage destination information. 

s 

29. A media processing apparatus comprising: 

an input means for inputting a data stream including 
compressed audio data and compressed video data; 

a sequential processing means for performing a 
sequential processing which is mainly for condition 
judgements, the sequential processing including performing a 
header analysis for analyzing a header which is assigned to a 
predetermined unit of data (hereinafter, called a "block") in 
the data stream and performing a decoding of compressed . audio 
data of the data stream; and 

a routine processing means for performing, in parallel 
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12 with the sequential processing, a routine processing which is 

13 mainly for routine calculations, the routine processing 

14 including a decoding of the compressed video data of the data 

15 stream for a block using a result of the header analysis, and 

16 wherein the sequential processing means instructs the 

17 routine processing means to decode the block when the header 

18 analysis of the block is completed, and starts the header 

19 analysis of a next block when receiving notification from the 

20 routine processing means that the decoding of the block is 

21 completed, 

22 ;U wherein the routine processing means is composed of: 

23 a data translation means for performing variable length 

24 J{ code decoding (abbreviated as the "VLD" hereafter ) 4 on ' the 

25 £ compressed video data of the data stream in accordance with an 
2 6 f instruction from the sequential processing means; 

27 Q a calculation means for performing inverse quantization 

28 =K (abbreviated as the "IQ" hereafter) and inverse discrete 

iT'l 

29 M cosine transformation (abbreviated as the "IDCT" hereafter) by 

30 executing a predetermined calculation on a video block 

31 obtained through the VLD; and 

32 a blending means for restoring video block data by 

33 performing motion compensation processing which is achieved by 

34 blending the decoded block with the video block on which the 

35 IDCT has been performed, 

36 wherein the sequential processing means is composed of: 

37 an obtaining means for obtaining header information on 
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38 which the VLD has been performed by the data translation 

39 means; 

40 an analyzing means for analyzing the obtained header 

41 information; 

42 a notifying means for reporting parameters obtained as 

43 a result of the header analysis to the routine processing 

44 means; 

45 an audio decoding means for decoding the compressed 

4 6 audio data of the data stream inputted by the input means; and 
47 u a control means for stopping an operation of the audio 

48, H decoding means and activating the obtaining means when 

49 £j receiving an interrupt signal from the routine processing 

p s 4 

50 v i means that indicates a decode completion of the block, and for 

51 m instructing the data translation means to start the VLD on the 

52 compressed video data of the data stream when the parameters 

53 ^ have been indicated by the notifying means, 

54 O wherein the calculation means includes 

55 a first buffer having a storage area whose capacity is 

56 equivalent to one block, and 

57 wherein the data translation means includes: 

58 a VLD means for performing the VLD on the compressed 

59 video data of the data stream; 

60 a first address table means for storing a first address 

61 sequence where addresses in the first buffer are arranged in 

62 an order for a zigzag scan; 

63 a second address table means for storing a second 
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address sequence where addresses in the first buffer are 
arranged in an order for an alternate scan; and 

a writing means for writing block data obtained through 
the VLD performed by the VLD means into the first buffer in 
accordance with one of the first address sequence and the 
second address sequence. 

30. The media processing apparatus of Claim 29, 
wherein the writing means includes : 

a table address generate means for sequentially 
generating a table address for the first address table means 
and the second address table means; 

an address select means for sequentially selecting one 
of an address of the first address sequence and an address of 
the second address sequence which are separately outputted 
from the first table means and the second table means. into 
which the table address has been inputted; and 

an address output means for outputting the selected 
address to the first buffer. 

31. The media processing apparatus of Claim 30, 
wherein the analyzing means calculates a quantization 

scale and a motion vector in accordance with the header 
information, and 

wherein the notifying means notifies the calculation 
means of the quantization scale and notifies the blending 
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means of the motion vector. 



32. The media processing apparatus of Claim 31, 

wherein the calculation means is composed of: 

a first control storage unit and a second control 

storage unit which each store a microprogram; 

a first program counter for designating a first read 

address to the first control storage unit; 

a second program counter for designating a second read 

address; 

a selector for selecting one of the first read address 
and the second read address and outputting the selected read 
address to the second control storage unit; and 4 

an execution unit, which includes a multiplier and an 

i 

adder, for executing the IQ and IDCT in block units according 
to microprogram control by the first control storage unit and 
the second control storage unit. 

33. The media processing apparatus of Claim 32, 
wherein the execution unit separately performs a 
processing using the multiplier and a processing using the 
adder in parallel when the second read address is selected by 
the selector, and performs the processing using the multiplier 
and the processing using the adder in coordination when the 
first read address is selected by the selector. 
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1 34. The media processing apparatus of Claim 33 , 

2 wherein the calculation means is further composed of 

3 a second buffer for holding a video block on which the 

4 IDCT has been performed by the execution unit, and 

5 wherein the first control storage unit stores a 

6 microprogram for the IQ and a microprogram for the IDCT, 

7 wherein the second control storage unit stores a 

8 microprogram for the IDCT and a microprogram for transferring 

9 a video block on which the IDCT has been performed to the 

10 second buffer, and 

11 %j wherein the execution means executes a processing to 

12 Q transfer the video block on which the IDCT has been performed 

13 ry to the second buffer and the IQ processing of a ne^t video 

14 m block in parallel, and executes the IDCT processing of the 

i 

15 ? s next video block, on which the IQ processing has been 

16 51 performed, using the multiplier and the adder in coordination. 

■ I 

1 35. The media processing apparatus of Claim 34, 

2 wherein the blending means further generates a 

3 differential block representing a differential image from 

4 video data which is to be compressed; 

5 wherein the second buffer stores the generate 

6 differential block, 

7 wherein the first control storage unit further stores a 

8 microprogram for discrete cosine transformation (abbreviated 

9 as the "DCT" hereafter) and a microprogram for quantization 



103 



10 processing (abbreviated as the "Q processing" hereafter), 

11 > wherein the second control storage unit further stores 

12 a microprogram for the DCT and a microprogram for transferring 

13 the video block on which the DCT has been performed to the 

14 first buffer, 

15 wherein the execution means further executes the DCT 

16 and Q processing on the differential block stored in the 

17 second buffer and transfers the differential block on which 

18 the DCT and Q processing has been performed to the first 

19 buffer, 

20 P wherein the data translation means further performs 

21 O variable length coding (abbreviated as the "VLC" hereafter) on 

22 PJ the block stored in the first buffer, and * 

23 K! wherein the sequential processing means further assigns 

24 fc* header information to a block on which the VLD has been 

25 flj performed by the data translation means. 

bh 

1 36. The media processing apparatus of Claim 32, 

2 wherein the input means further inputs polygon data, 

3 wherein the sequential processing means further 

4 analyzes the polygon data and calculates vertex coordinates 

5 and edge inclinations of the polygon, and $ 

6 wherein the routine processing means further generates 

7 image data of the polygon in accordance with the calculated 

8 vertex coordinates and edge inclinations. 
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37. The media processing apparatus of Claim 36, 
wherein the first control storage unit and the second 

control storage unit each store a microprogram for performing 
a scan conversion based on a digital differential analyze 
algorithm, and 

wherein the execution unit performs the scan conversion 
based on the vertex coordinates and edge inclinations 
calculated by the sequential processing means according to 
control of the microprogram, 

38. The media processing apparatus of Claim 31, 
wherein the calculation means is composed of: 

a first control storage unit and the second control 
storage unit for respectively storing a microprogram; 

a first program counter for designating a first read 
address to the first control storage unit; 

a second program counter for designating a second read 

address; 

a selector for selecting one of the first read address 
and the second read address and outputting the selected 
address to the second control storage unit; and 

a plurality of execution units for executingjfche IQ and 
IDCT in units of blocks according to control of the 
microprogram by the first control storage unit and the second 
control storage unit, each execution unit including a 
multiplier and an adder, and 
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17 wherein each execution unit takes charge of a partial 

18 block which is divided from the block. 

1 39. The media processing apparatus of Claim 38, 

2 wherein the calculation means is further composed of: 

3 a plurality of address translation tables which are set 

4 corresponding to the plurality of execution units, each 

5 address translation table storing translated addresses whose 

6 order is partially changed in a predetermined address 

7 sequence; 

8 n an instruction register group including a plurality of 

f i 

9 55 registers which each store a microinstruction associated with 

r 1 • ? 

10 m one of the translated addresses, each microinstruction forming 

11 % part of a microprogram that realizes a predetermined 

12 T, calculation; and 

13 J;i a switching unit, which is set between the first and 

14 % second control storage units and the plurality of execution 

15 N= units, for outputting microinstructions from the instruction 

16 registers to the plurality of execution units in place of a 

17 microinstruction outputted from one of the first control 

18 storage unit and the selector to every execution unit, and 

19 wherein when the first read address or the s^fcond read 

20 address is an address of the predetermined address sequence, 

21 the address is translated into the translated addresses by the 

22 address translation tables, and 

23 wherein the instruction register group outputs the 
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24 microinstructions corresponding to the translated addresses 

25 outputted from the address translation tables. 

1 40. The media processing apparatus of Claim 39, 

2 wherein 

3 when a microinstruction indicating one of an addition 

4 or subtraction operation is outputted from one of the 

5 instruction registers, each address translation table outputs 

6 a flag showing whether the microinstruction indicates an 

7 addition or a subtraction while the first program counter is 

8 O outputting the first read address in the predetermined address 

Q 

9 P sequence, 

10 III the plurality of execution units perform addition or 

11 03 subtraction in accordance with the flag, and 

12 jU the flag is set in accordance with the microinstruction 

13 !1j of the second control storage unit. 

Is J 

1 41. The media processing apparatus of Claim 39, 

2 wherein the second control storage unit further outputs 

3 information showing a storage destination of a 

4 microinstruction execution result at a same time of an output 

5 of the microinstruction stored in the register while»lthe first 

6 program counter outputs the first read address of the 

7 predetermined address sequence, and 

8 wherein each execution unit stores the execution result 

9 in accordance with the storage destination information. 
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1 42. A media processing apparatus which inputs a data 

2 stream including compressed audio data and compressed video 

3 data, decodes the inputted stream data, and outputs the 

4 decoded data, the media processing apparatus comprising: 

5 an input/output processing means for performing an 

6 input/output processing, the input/output processing including 

7 storing a data stream asynchronously inputted due to an 

8 external factor in a memory; 

9 a sequential processing means for performing a 

10 sequential processing mainly for condition judgements, the 

lip sequential processing including a header analysis of the 

12 Q compressed audio data and the compressed video data and a 

13 pj decoding of the compressed audio data, whereby the* decoded 

14 m audio data is stored in the memory; and 

fee* I 

15 y h a routine processing means for performing a routine 

16|1 processing mainly for routine calculations on the compressed 

17 % video data stored in the memory in accordance with a result of 

18^ the header analysis given by the sequential processing means, 

19 the routine processing including a decoding of the compressed 

20 video data, whereby the decoded video data is stored in the 

21 memory, and 

22 wherein the input/output processing further includes 

23 reading the decoded audio data and the decoded video data from 

24 the memory and respectively outputting the read audio data and 

25 the read video data to an audio output device and an external 

26 display device in accordance with respective output rates. 



108 



1 43. The media processing apparatus of Claim 42, 

2 wherein the sequential processing means alternates 

3 between performing a header analysis for analyzing a header 

4 which is assigned to a predetermined unit of data 

5 (hereinafter, called a "block") in the data stream and 

6 performing a decoding of the compressed audio data in the data 

7 stream, instructs the routine processing means to decode a 

8 block when the header analysis for the block is completed, and 

9 starts the header analysis of a next block when receiving 

10 g . notification from the routine processing means that the 

11 O decoding of the block is completed; and 

12 O wherein the routine processing means decodes. the 

13 W compressed video data for a block in accordance with a result 

14 05 of the header analysis given by the sequential processing 

i 

15 means . 

lp 44. The media processing apparatus of Claim 43, 

2 wherein the routine processing means is composed of: 

3 a data translation means for performing variable length 

4 code decoding (abbreviated as the "VLD" hereafter) on the 

5 compressed video data of the data stream in accordance with an 

6 instruction from the sequential processing means; ^ 

7 a calculation means for performing inverse quantization 

8 (abbreviated as the "IQ" hereafter) and inverse discrete 

9 cosine transformation (abbreviated as the "IDCT" hereafter) by 
10 executing a predetermined calculation on a video block 
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11 obtained through the VLD; and 

12 a blending means for restoring video block data which 

13 corresponds to the video block by blending a decoded 

14 rectangular image of a frame stored in the memory with the 

15 video block data on which the IDCT has been performed. 

1 45 • The media processing apparatus of Claim 44, 

2 wherein the calculation means includes 

3 a first buffer having a storage area whose capacity is 

4 equivalent to one block, and 

- &. 

5 £3 wherein the data translation means includes: ' 

6 O a VLD means for performing the VLD on the cpmpressed 

7 jy video data of the data stream; 4 

y ig a first address table means for storing a first address 

9 jU sequence where addresses in the first buffer are arranged in 

10 ** an order for a zigzag scan; 

11 5 a second address table means for storing a second 

12 r address sequence where addresses in the first buffer are 

13 arranged in an order for an alternate scan; and 

14 a writing means for writing block data obtained through 

15 the VLD performed by the VLD means into the first buffer in 

16 accordance with one of the first address sequence and* ! the 

17 second address sequence. 

1 46. The media processing apparatus of Claim 45, 

2 wherein the writing means includes: 
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3 a table address generate means for sequentially 

4 generating a table address for the first address table means 

5 and the second address table means; 

6 an address select means for sequentially selecting one 

7 of an address of the first address sequence and an address of 

8 the second address sequence which are separately outputted 

9 from the first table means and the second table means into 

10 which the table address has been inputted; and 

11 an address output means for outputting the selected 

12 address to the first buffer. 



lfl 47. The media processing apparatus of Claim 42, 

2 ry wherein the input /output processing means <Ls composed 

3m of: 

4 L an input means for inputting an asynchronous data 

5 W\ stream; 

6% a video output means for outputting the decoded video 

%sStt 

1" data to the external display device; 

8 an audio output means for outputting the decoded audio 

9 data to the external audio output device; and 

10 a processor for executing task programs from a first 

11 task program to a fourth task program stored in an instruction 

12 memory, by switching between the four task programs, the task 

13 programs including: 

14 the first task program for transferring the data stream 

15 from the input means to the memory; 
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the second task program for supplying the data stream 
from the memory to the decode processing means; 

the third task program for outputting the decoded video 
data from the memory to the video output means; and 

the fourth task program for outputting the decoded 
audio data from the memory to the audio output means. 

1 48. The media processing apparatus of Claim 47, 

2 wherein the processor is composed of: 

3 a program counter unit including at least four program 

4 0 counters corresponding to the task programs from the first 

5 O task program to the fourth task program; • ^ 

6 Pj an instruction fetch unit for fetching an instruction 

7 CP from the instruction memory which stores the task programs, 

8 h* using an instruction address designated by one of the program 
counters; 

an instruction execution unit for executing the 
instruction fetched by the instruction fetch unit; and 

a task control unit for controlling the instruction 
fetch unit to sequentially switch the program counter every 
time a predetermined number of instruction cycles have 
elapsed. ^ 

1 49. The media processing apparatus of Claim 48, 

2 wherein the processor is further composed of 

3 a register unit including at least four register sets 
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4 corresponding to the program tasks from the first task program 

5 to the fourth task program, and 

6 wherein the task control unit, simultaneously with 

7 switching of a program counter, switches a present register 

8 set to a register set which is to be used by the instruction 

9 execution unit. 

1 50. The media processing apparatus of Claim 49, 

2 wherein the task control unit is composed of: 

3 a counter for counting a number of instruction cycles 

4 O in accordance with a clock signal every time the program 

5 O counter is switched; and { 

6 TU a switch instruction unit for controlling the 

7 m instruction fetch unit to switch the program counter when a 

8 L count value of the counter reaches the predetermined number. 

M 

ru 

1 5 51. The media processing apparatus of Claim 49, 

2 r " wherein the routine processing means is composed of: 

3 a data translation means for performing variable length 

4 code decoding (abbreviated as the "VLD" hereafter) on the 

5 compressed video data of the data stream in accordance with an 

6 instruction from the sequential processing means; ^ 

1 a calculation means for performing inverse quantization 

8 (abbreviated as the "IQ" hereafter) and inverse discrete 

9 cosine transformation (abbreviated as the "IDCT" hereafter) by 

10 executing a predetermined calculation on a video block 
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obtained through the VLD; and 

a blending means for restoring video block data which 
corresponds to the video block by blending a decoded 
rectangular image of a frame stored in the memory with the 
video block data on which the IDCT has been performed. 

1 52. The media processing apparatus of Claim 51, 

2 wherein the analyzing means calculates a quantization 

3 scale and a motion vector in accordance with the header 

4 information, and 

5 Q wherein the notifying means notifies the calculation 

S3 

6 C3 means of the quantization scale and notifies the blending 

7 III means of the motion vector. * 



1 hk 53. The media processing apparatus of Claim 52, 

as;*. 

i » 

2 pj wherein the calculation means is composed of:. 

3 S a first control storage unit and a second control 

4 storage unit which each store a microprogram; 

5 a first program counter for designating a first read 

6 address to the first control storage unit; 

7 a second program counter for designating a second read 

8 address; ^ 

9 a selector for selecting one of the first read address 

10 and the second read address and outputting the selected read 

11 address to the second control storage unit; and 

12 an execution unit, which includes a multiplier and an 



114 



13 adder, for executing the IQ and IDCT in block units according 

14 to microprogram control by the first control storage unit and 

15 the second control storage unit. 

1 54. The media processing apparatus of Claim 53, 

2 wherein the execution unit separately performs a 

3 processing using the multiplier and a processing using the 

4 adder in parallel when the second read address is selected by 

5 the selector, and performs the processing using the multiplier 

6 and the processing using the adder in coordination, when the 



7 p first read address is selected by the selector. 

M 



1 jy 55. The media processing apparatus of Claim 4 54, 

2 pj wherein the calculation means is further composed of: 

i 

2: 

3 ^ a first buffer for holding a video block inputted from 

4 pj the data translation means; and 

5 fj a second buffer for holding a video block on which the 

■Lis 

6 " IDCT has been performed by the execution unit, and 

7 wherein the first control storage unit stores a 

8 microprogram for the IQ and a microprogram for the IDCT, 

9 wherein the second control storage unit stores a 

10 microprogram for the IDCT and a microprogram for transferring 

11 a video block on which the IDCT has been performed to the 

12 second buffer, and 

13 wherein the execution means executes a processing to 

14 transfer the video block on which the IDCT has been performed 
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15 to the second buffer and the IQ processing of a next video 

16 block in parallel, and executes the IDCT processing of the 

17 next video block, on which the IQ processing has been 

18 performed, using the multiplier and the adder in coordination, 

1 56. The media processing apparatus of Claim 55, 

2 wherein the blending means further generates a 

3 differential block representing a differential image from 

4 video data which is to be compressed; 

5 wherein the second buffer stores the generated 

6 Q differential block, 

o 

7 p wherein the first control storage unit further stores a 

8 pj microprogram for discrete cosine transformation (abbreviated 

9 m as the "DCT" hereafter) and a microprogram for quantization 

i 

e 

10 p processing (abbreviated as the "Q processing" hereafter), 

11 51 wherein the second control storage unit further stores 

12 a microprogram for the DCT and a microprogram for transferring 

13 5 the video block on which the DCT has been performed to the 

14 first buffer, 

15 wherein the execution means further executes the DCT 

16 and Q processing on the differential block stored in the 

17 second buffer and transfers the differential block on 4 which 

18 the DCT and Q processing has been performed to the first 

19 buffer, 

20 wherein the data translation means further performs 

21 variable length coding (abbreviated as the "VLC" hereafter) on 
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22 the block stored in the first buffer, and 

23 wherein the sequential processing means further assigns 

24 header information to a block on which the VLD has been 

25 performed by the data translation means. 

1 57. The media processing apparatus of Claim 52, 

2 wherein the calculation means is composed of: 

3 a first control storage unit and the second control 

4 storage unit for respectively storing a microprogram; 

5 a first program counter for designating a first read 

6 O address to the first control storage unit; 

Q 

7 Q a second program counter for designating a second read 

%. i ' *' 

8 flj address; * 

9 03 ' a selector for selecting one of the first read address 

10 j-t and the second read address and outputting the selected 

11 ffl address to the second control storage unit; and 

•} -US 

12 JK a plurality of execution units for executing the IQ and 

13 " IDCT in units of blocks according to control of the 

14 microprogram by the first control storage unit and the second 

15 control storage unit, each execution unit including a 

16 multiplier and an adder, and 

17 wherein each execution unit takes charge of a^partial 

18 block which is divided from the block. 

1 58. The media processing apparatus of Claim 57, 

2 wherein the calculation means is further composed of: 
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a plurality of address translation tables which are set 
corresponding to the plurality of execution units, each 
address translation table storing translated addresses whose 
order is partially changed in a predetermined address 
sequence; 

an instruction register group including a plurality of 
registers which each store a microinstruction associated with 
one of the translated addresses, each microinstruction forming 
part of a microprogram that realizes a predetermined 
calculation; and 

a switching unit, which is set between the first and 
second control storage units and the plurality of execution 
units, for outputting microinstructions from the instruction 
registers to the plurality of execution units in place of a 
microinstruction outputted from one of the first control 
storage unit and the selector to every execution unit, and 

wherein when the first read address or the second read 
address is an address of the predetermined address sequence, 
the address is translated into the translated addresses by the 
address translation tables, and 

wherein the instruction register group outputs the 
microinstructions corresponding to the translated addz^sses 
outputted from the address translation tables. 

59. The media processing apparatus of Claim 58, 
wherein 
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when a itdcroinstruction indicating one of an addition 
or subtraction operation is outputted from one of the 
instruction registers, each address translation table outputs 
a flag showing whether the microinstruction indicates an 
addition or a subtraction while the first program counter is 
outputting the first read address in the predetermined address 
sequence, 

the plurality of execution units perform addition or 
subtraction in accordance with the flag, and 

the flag is set in accordance with the microinstruction 
of the second control storage unit. 

... .,i 

60* The media processing apparatus of Clainf 58, 
wherein the second control storage unit further outputs 
information showing a storage destination of a 
microinstruction execution result at a same time of an output 
of the microinstruction stored in the register while the first 
program counter outputs the first read address of the 
predetermined address sequence, and 

wherein each execution unit stores the execution result 
in accordance with the storage destination information, 

61. The media processing apparatus of Claim 51, 
wherein the calculation means includes 

a first buffer having a storage area whose capacity is 
equivalent to one block, and 
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wherein the data translation means includes: 

a VLD means for performing the VLD on the compressed 
video data of the data stream; 

a first address table means for storing a first address 
sequence where addresses in the first buffer are arranged in 
an order for a zigzag scan; 

a second address table means for storing a second 
address sequence where addresses in the first buffer are 
arranged in an order for an alternate scan; and 

a writing means for writing block data obtained through 
the VLD performed by the VLD means into the first buffer in 
accordance with one of the first address sequence and the 
second address sequence. 4 

i 

62. The media processing apparatus of Claim 61, 

wherein the writing means includes: 

a table address generate means for sequentially 
generating a table address for the first address table means 
and the second address table means; 

an address select means for sequentially selecting one 
of an address of the first address sequence and an address of 
the second address sequence which are separately outpiittted 
from the first table means and the second table means into 
which the table address has been inputted; and 

an address output means for outputting the selected 
address to the first buffer. 
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1 63. The media processing apparatus of Claim 62, 

2 wherein the analyzing means calculates a quantization 

3 scale and a motion vector in accordance with the header 

4 information, and 

5 wherein the notifying means notifies the calculation 

6 means of the quantization scale and notifies the blending 

7 means of the motion vector. 

1 64. The media processing apparatus of Claim 63, 

2 wherein the calculation means is composed of: 

3 p a first control storage unit and a second control 

4 p storage unit which each store a microprogram; 

5 j?y a first program counter for designating a first read 

6 K address to the first control storage unit; 

7 1^ a second program counter for designating a second read 

8 Jf- address; 

a selector for selecting one of the first read address 
and the second read address and outputting the selected read 
address to the second control storage unit; and 

an execution unit, which includes a multiplier and an 
adder, for executing the IQ and IDCT in block units according 
to microprogram control by the first control storage Anit and 
the second control storage unit. 

1 65. The media processing apparatus of Claim 64, 

2 wherein the execution unit separately performs a 
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processing using the multiplier and a processing using the 
adder in parallel when the second read address is selected by 
the selector, and performs the processing using the multiplier 
and the processing using the adder in coordination when the 
first read address is selected by the selector. 

66. The media processing apparatus of Claim 65, 
wherein the calculation means is further composed of 

a second buffer for holding a video block on which the 
IDCT has been performed by the execution unit, and 

wherein the first control storage unit stores a 
microprogram for the IQ and a microprogram for the IDCT, 

wherein the second control storage unit st6res a 
microprogram for the IDCT and a microprogram for transferring 
a video block on which the IDCT has been performed to the 
second buffer, and 

wherein the execution means executes a processing to 
transfer the video block on which the IDCT has been performed 
to the second buffer and the IQ processing of a next video 
block in parallel, and executes the IDCT processing of the 
next video block, on which the IQ processing has been 
performed, using the multiplier and the adder in coordination. 

67. The media processing apparatus of Claim 66, 
wherein the blending means further generates a 

differential block representing a differential image from 
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video data which is to be compressed; 

wherein the second buffer stores the generated 
differential block, 

wherein the first control storage unit further stores a 
microprogram for discrete cosine transformation (abbreviated 
as the "DCT" hereafter) and a microprogram for quantization 
processing (abbreviated as the "Q processing" hereafter) , 

wherein the second control storage unit further stores 
a microprogram for the DCT and a microprogram for transferring 
the video block on which the DCT has been performed to the 
first buffer, 

wherein the execution means further executes t,he DCT 
and Q processing on the differential block stored In the 

second buffer and transfers the differential block on which 

s 

the DCT and Q processing has been performed to the first 
buffer, 

wherein the data translation means further performs 
variable length coding (abbreviated as the "VLC" hereafter) on 
the block stored in the first buffer, and 

wherein the sequential processing means further assigns 
header information to a block on which the VLD has been 

Ai 

performed by the data translation means. 

68. The media processing apparatus of Claim 63, 
wherein the calculation means is composed of: 

a first control storage unit and the second control 
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storage unit for respectively storing a microprogram; 

a first program counter for designating a first read 
address to the first control storage unit; 

a second program counter for designating a second read 

address; 

a selector for selecting one of the first read address 
and the second read address and outputting the selected 
address to the second control storage unit; and 

a plurality of execution units for executing the IQ and 
IDCT in units of blocks according to control of the 
microprogram by the first control storage unit and the second 
control storage unit, each execution unit including a ■ { 
multiplier and an adder, and 4 

wherein each execution unit takes charge of a partial 

i 

block which is divided from the block. 

1 K 69. The media processing apparatus of Claim 68, 

2 r ~ wherein the calculation means is further composed of: 

3 a plurality of address translation tables which are set 

4 corresponding to the plurality of execution units, each 

5 address translation table storing translated addresses whose 

6 order is partially changed in a predetermined address" 

7 sequence; 

8 an instruction register group including a plurality of 

9 registers which each store a microinstruction associated with 
10 one of the translated addresses, each microinstruction forming 
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11 part of a microprogram that realizes a predetermined 

12 calculation; and 

13 a switching unit, which is set between the first and 

14 second control storage units and the plurality of execution 

15 units , for outputting microinstructions from the instruction 

16 registers to the plurality of execution units in place of a 

17 ' microinstruction outputted from one of the first control 

18 storage unit and the selector to every execution unit, and 

19 wherein when the first read address or the second read 

20 address is an address of the predetermined address sequence, 

21 Q the address is translated into the translated addresses by the 

22 p address translation tables, and { 

23 pj wherein the instruction register group outptts the 

24 |g microinstructions corresponding to the translated addresses 

s 

25 },& outputted from the address translation tables. 

1 q 70. The media processing apparatus of Claim 69, 

2 wherein 

3 when a microinstruction indicating one of an addition 

4 or subtraction operation is outputted from one of the 

5 instruction registers, each address translation table outputs 

6 a flag showing whether the microinstruction indicates * 5 an 

7 addition or a subtraction while the first program counter is 

8 outputting the first read address in the predetermined address 

9 sequence, 

10 the plurality of execution units perform addition or 
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11 subtraction in accordance with the flag, and 

12 the flag is set in accordance with the microinstruction 

13 of the second control storage unit, 

1 71. The media processing apparatus of Claim 69, 

2 wherein the second control storage unit further outputs 

3 information showing a storage destination of a 

4 microinstruction execution result at a same time of an output 

5 of the microinstruction stored in the register while the first 

6 program counter outputs the first read address of the 

7 W predetermined address sequence, and 

8 P wherein each execution unit stores the execution result 

9 fy in accordance with the storage destination information . 
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